On the Algebraic Structure of Certain Partially Observable Finite-State Markov Processes
نویسنده
چکیده
We consider a class of nonlinear estimation problems possessing certain algebraic properties, and we exploit these properties in order to study the computational complexity of nonlinear estimation algorithms. Specifically, we define a class of finite-state Markov processes evolving on finite groups and consider noisy observations of these processes. By introducing some concepts from the theory of representations of finite groups, we are able to define a pair of "dual" filtering algorithms. We then study several specific classes of groups in detail, and, by developing a generalization of the fast Fourier transform algorithm, we derive an efficient nonlinear filtering algorithm. A continuous-time version of these ideas is developed for cyclic groups.
منابع مشابه
A Partially Observable Markovian Maintenance Process with Continuous Cost Functions
In this paper a two-state Markovian maintenance process where the true state is unknown will be considered. The operating cost per period is a continuous random variable which depends on the state of the process. If investigation cost is incurred at the beginning of any period, the system wit I be returned to the "in-control" state instantaneously. This problem is solved using the average crite...
متن کاملFinding the Value of Information About a State Variable in a Markov Decision Process
Finding the Value of Information About a State Variable in a Markov Decision Process Gilvan C. Souza The Robert H. Smith School of Business, The University of Maryland, College Park, MD, 20742 Phone: 301-405-0628; fax: 301-405-8655; email: [email protected] ABSTRACT In this paper we present a mixed–integer programming formulation that computes the optimal solution for a certain class of Markov dec...
متن کاملOn the Undecidability of Probabilistic Planning and Infinite-Horizon Partially Observable Markov Decision Problems
We investigate the computability of problems in probabilistic planning and partially observable infinite-horizon Markov decision processes. The undecidability of the string-existence problem for probabilistic finite automata is adapted to show that the following problem of plan existence in probabilistic planning is undecidable: given a probabilistic planning problem, determine whether there ex...
متن کاملOn the Average Cost Optimality Equation and the Structure of Optimal Policies for Partially Observable Markov Decision Processes*
We consider partially observable Markov decision processes with finite or countably infinite (core) state and observation spaces and finite action set. Following a standard approach, an equivalent completely observed problem is formulated, with the same finite action set but with an uncountable state space, namely the space of probability distributions on the original core state space. By devel...
متن کاملApproximate Linear Programming for Constrained Partially Observable Markov Decision Processes
In many situations, it is desirable to optimize a sequence of decisions by maximizing a primary objective while respecting some constraints with respect to secondary objectives. Such problems can be naturally modeled as constrained partially observable Markov decision processes (CPOMDPs) when the environment is partially observable. In this work, we describe a technique based on approximate lin...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Information and Control
دوره 38 شماره
صفحات -
تاریخ انتشار 1978